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(57) Abstract 

Imaging hardware, software, 
calibrants and methods are provided 
to visualize and quantitate the amount 
of Fluorescence Resonance Energy 
Transfer (FRET) occurring between 
donor and - acceptor molecules in 
epifluorescence microscopy (1). The 
MicroFRET - system compensates for 
overlap among donor, acceptor and 
FRET spectra using well characterized 
fluorescent beads as standards in 
conjunction . with radiometrically 
calibrated image processing techniques. 
The MicroFRET system also provides 
precisely machined epifluorescence 
cubes (4) to maintain proper image 
registration as the sample is illuminated 
(3) at the donor and acceptor excitation 
wavelengths. Algorithms are 

described that pseudocolor the 
image to display pixels exhibiting 
radiometrically-corrected fluorescence 
emission from the donor (blue), the 
acceptor (green) and FRET (red). The 
method is demonstrated on samples 
exhibiting FRET between genetically 
engineered derivatives of the Green 
Fluorescent Protein (GFP) bound to 
the surface of Ni chelating beads by 
histidine-tags. 
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CALIBRATION OF FLUORESCENCE RESONANCE 
ENERGY TRANSFER IN MICROSCOPY 

STATEMENT AS TO FEDERALLY SPONSORED RESEARCH 
This invention was made at least in part with funds from the Federal Government, 
Department of Energy. The Government may have certain rights in the invention. 

CLAIM OF PRIORITY 

This application claims priority under 35 USC §1 19(e) to U.S. Patent Application 
Serial No. 60/048,696, filed June 5, 1997, and to U.S. Patent Application Serial No. 
60/057,931, filed September^ 1997. 

TECHNICAL FIELD 

This invention relates generally to fluorescence resonance energy transfer (FRET), 
and more particularly to calibration standards for FRET. 

BACKGROUND 

Fluorescence resonance energy transfer (FRET) is a non-radiative process whereby 
energy from a fluorescent donor molecule is transferred to an acceptor molecule without the 
involvement of a photon. Excitation of the donor molecule enhances the fluorescence 
emission of the longer-wavelength acceptor molecule (i.e., sensitized acceptor emission). The 
quantum yield of the donor fluorescence emission is concomitantly diminished. FRET has 
become a valuable tool for microscopy, because the efficiency of energy transfer has a strong 
inverse dependence on the distance between the donor and acceptor molecules. Thus, the 
appearance of FRET is a highly specific indicator of the proximity of the two molecules. This 
has led to the use of FRET efficiency as a "spectroscopic ruler" to measure molecular 
distances. 

A typical FRET experiment for observing cells involves specifically labeling 
particular molecules with fluorescent dyes and detecting these dyes over selected excitation 
and emission wavelength ranges. These wavelength ranges are commonly referred to as 
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"channels" for a particular fluorophore. Fluorescent labeling is easier to accomplish for 
extracellular molecules than for intracellular ones. For intracellular molecules, the dye- 
conjugated molecules must be either injected into the cell for observation or the labeled 
molecules may be overlaid onto a thin section of fixed, permeabilized tissue. Recently, 
however, the availability of green fluorescent protein (GFP) mutants with shifted excitation 
and emission spectra has made it feasible to measure protein-protein interactions by using 
GFP tags as intracellular markers. GFP-tagged protein chimeras are expressed intracellularly 
and do not require any chemical treatment to become fluorescent. FRET can also occur 
between fusions of blue-emitting and green-emitting GFP variants. 

Although FRET microscopy has the potential to become a widely used analytical tool 
in these systems, accurate steady-state measurement of FRET by standard epifluorescence 
microscopy has been hindered by several limitations, including: 

(1) Bleed-through or spillover of donor (and isolated acceptor) fluorescence emission 
into the FRET channel due to spectral overlap. Compensation for spectral overlap requires 
the use of accurate calibration standards to determine the correction factors. 

(2) Image registration. Correcting each pixel in an image for spectral overlap requires 
taking three separate images with each of the three epifluorescence cubes (i.e., donor 
emission, acceptor emission, and sensitized acceptor emission). If the surfaces of all three 
epifluorescence cubes are not exactly parallel, image registration is lost and the resultant 
geometric distortion will also have to be corrected. Loss of image registration greatly 
complicates the correction procedure and reduces the overall accuracy of the corrected data. 

(3) Calculation of FRET by sensitized emission has a large uncertainty when the 
FRET efficiency is low. 

(4) Photobleaching of the donor during the measurement results in anomalously low 
estimates of FRET in the sample. 

These limitations apply to GFP as well as to other fluorescent FRET pairs. 

Because of recent advances in "chromosome painting," cell biologists are becoming 
familiar with epifluorescence microscopes that utilize multi-bandpass filters to obtain 
information on several dyes simultaneously. Some of these instruments employ interfero- 
metry, while others use filter wheels in the excitation path to select specific excitation bands. 
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In both cases, an assumption is made that excitation at a given wavelength results in emission 
from the next reddest transmission band. While multiband cubes help to solve the image 
registration problem for separable dyes, fluorescence phenomena which involve large or 
variable Stokes shifts cannot be addressed. Multiband systems'cannot be used to detect FRET 
because the FRET emission channel is not the next (redder) emission band and is therefore 
indistinguishable from the donor's emission. 

Accordingly, the inventors have determined that a need exists for an improved FRET 
system which provides for close image registration, and minimizes or corrects for low FRET 
efficiency, photobleaching, and spectral overlap. The present invention provides for such a 
system. 

SUMMARY 

The invention provides a method for transforming an initial image of biological 
material to a processed image, the initial image being represented by a set of pixels each 
having three color space coordinates. The method includes the steps of (a) selecting at least 
two image regions in the initial image, each image region including at least one pixel, 
wherein the image regions define at least two distinguishable spectral categories; (b) 
performing a color space transformation on the initial image, based on the color space 
coordinates of the pixels in each of the selected image regions, to generate a processed image; 
and (c) evaluating the processed image for a visible indication of an improved spatial 
distribution of color. 

The invention further provides a quantitative method for color space transforming an 
initial FRET image of biological material to a corrected FRET image, and includes applying 
other image corrections. 

The invention also provides a set of calibration targets for FRET. The set of calibra- 
tion targets includes: (a) a pure donor target for binding only to donor molecules; (b) a pure 
acceptor target for binding only to acceptor molecules; and (c) a donor and acceptor target for 
binding to a mixture of donor and acceptor molecules which exhibit FRET. In a specific 
embodiment, the set of calibration targets are genetically engineered derivatives of the Green 
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Fluorescent Protein (GFP) bound to the surface of Ni chelating beads by histidine-tags (His-tags). 

The details of one or more embodiments of the invention are set forth in the accompa- 
nying drawings and the description below. Other features, objects, and advantages of the 
invention will be apparent from the description and drawings, -and from the claims. 

DESCRIPTION OF DRAWINGS 

FIG. la is a block diagram showing one embodiment of a FRET imaging microscope 
for acquiring spatially co-registered electronic images suitable for use with the present 
invention. 

FIG. lb 

is a diagram of an epifluorescence filter cube. 
FIG. 2, panel A shows the fluorescence excitation (thin lines) and emission (thick 
lines) spectra of BFP1 1 (blue) and RSGFP4 (green) proteins attached to chelating Sepharose 
beads via their His tags. Panel B is a comparison between the fluorescence emission of the 
BFP1 1 and RSGFP4 FRET pair bound (thick line) and following release (thin line) from 
chelating beads. 

FIG. 3 is an output from a MicroFRET graphical user interface, showing three 
monochrome images taken of the bead mixture using the donor, acceptor, and FRET 
epifluorescence cubes described in TABLE 1 . These images have been combined to produce 
an RGB image which does not fully differentiate among the three bead types because of 
spectral overlap. Windows: lower right (C,); lower left (C,); upper right (C,); upper left 
(RGB). 

FIG. 4 is an orthonormalization of the color axes for a red-green-blue (RGB) display. 
This color-correction algorithm redefines the color axes from the dotted arrows of a conven- 
tional RGB display (lower left) to the solid axes of the orthonormalized image (upper right). 
This process results in the primary colors (red, green, blue) being assigned to the three pixel 
or bead types (FRET, Acceptor, Donor), respectively. Thus, the poorly differentiated colors 
of the raw RGB image shown in FIG. 3 (F, A, and D) are transformed by orthonormalization 
into pure red (F*), green (A'), and blue (D'). 

FIG. 5 shows the spectral overlap correction and orthonormalization of donor, 
acceptor, and FRET beads. 
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FIG. 6 shows the surface of the chelating bead, as represented by a horizontal black 
line, with GFP donors and acceptors (e.g., BFP and RSGFP) shown as blue and green vertical 
lines, respectively. Six different types of possible interactions are labeled A-F. In this 
drawing, only adjacent molecules are considered to be within an efficient FRET distance. 

FIG. 7 is a set of spatially coregistered color-coded images which show Baculovirus- 
infected Sf9 cells expressing a blue-emitting derivative of GFP (i.e., BFP1 1), a green- 
emitting derivative with red-shifted excitation {i.e., RSGFP4), and a BFP1 1/RSGFP4 fusion 
protein that is efficient at FRET. The donor, acceptor, and FRET signals have been separated 
and pseudocolored blue, green, and red, respectively, by the qualitative MicroFRET imaging 
system based on picking candidate D, A, and F pixels. 

FIG. 8, panel A shows the fluorescence excitation (thin lines) and emission (thick 
lines) spectra of a blue (BFP1 1) and a green (RSGFP4) GFP derivative chelated to Ni/NTA 
Sepharose beads via the proteins' His-tags. These spectra are virtually indistinguishable from 
those of the corresponding purified proteins in solution. Panel B is a comparison between the 
fluorescence emission (with excitation at the donor's wavelength, 370 nm) of the 
BFP1 1/RSGFP4 FRET pair bound to the bead (thick line) and following release (thin line) by 
treatment with imidazole. The spectra shown in FIG. 8 confirm that the fluorescence 
emission from the FRET Bead is due to energy transfer, and that the spectral properties of the 
two GFP variants have not changed as a result of binding to the Ni/NTA Sepharose beads. 

FIG. 9 shows hematoxylin and eosin (H&E) slides of stained thin sections of cardiac 
tissue including an infarct. The left panel shows the true-color image generated by combining 
three separate monochrome images at 450, 550, and 650 nm of the H&E stained tissue. The 
right panel shows this image after orthonormalization in accordance with the invention. 
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DETAILED DESCRIPTION 

Overview 

The invention provides a new system for FRET imaging microscopy, based on 
epifiuorescence microscopy. In a preferred embodiment known*as the MicroFRET system, 
precisely machined epifiuorescence cubes are used to maintain proper image registration in 
order to allow correction for spectral overlap. The MicroFRET system also utilizes fluores- 
cent protein standards which are reversibly bound to high-performance Sepharose beads. 

In addition, newly designed software is capable of displaying processed pixel images 
of donor, acceptor, and FRET pixel information. Calibration parameters obtained from 
tagged beads can be applied to other images where the conditions under which the images are 
acquired are identical. This new design also makes it feasible to detect relatively small 
amounts of FRET within a given pixel, because the mathematical correction is much simpler 
(and therefore more accurate) than was previously possible. 

Steady-state FRET imaging of cells by sensitized emission, using conventional 
microscopy, has previously suffered from an inability to correct for spectral overlap while 
maintaining spatial accuracy. Until now, the three epifiuorescence cubes (donor, acceptor and 
FRET) that must be used to generate the correction values have been manufactured with 
optical surfaces that are not strictly parallel. This defect created geometric distortions in the 
image (i.e.. displacement of pixels) after the images were combined. The invention utilizes 
epifiuorescence cubes which have been machined to precise tolerances, so that spatial co- 
registration is maintained for all of the images. The invention also provides beads that are 
useful as calibration standards, so that spectral overlap can be corrected and features can be 
identified within the image that display donor emission, acceptor emission, and donor- 
sensitized acceptor emission (FRET). By subsequently applying an orthonormalization 
algorithm ("pixel purification"), the pure donor, pure acceptor, and FRET beads are pro- 
cessed as blue, green, and red, respectively. The processing is useful to cell biologists who 
seek to determine the spatial distribution of each of the three fluorescent components. 

Another concern with sensitized emission using conventional microscopy has been 
that the exciting light can photobleach the donor, thereby reducing the apparent intensity of 
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the FRET signal. However, by utilizing a high sensitivity camera, the sensitized emission 
technique of the invention does not reduce the FRET signal by more than about 5%. 

The invention provides quantitative FRET technology in 3-dimensional imaging 
systems such as confocal microscopes. Potential applications of quantitative FRET micros- 
5 copy are almost innumerable and span several disciplines in biology, from basic mechanistic 
aspects of cell biology to the discovery of new pharmaceuticals. 

The device of the invention and improved methods for FRET microscopy will 
facilitate cell biology experiments involving tagged proteins (e.g., protein-protein interac- 
tions) as well as drug discovery (protein-small molecule interactions), where there is a need 
10 . to quantitate the extent to which two molecules are interacting. 

The invention includes bead standards applicable to 3-D imaging, as well as software 
that calibrates volume elements. 

Unless otherwise defined, all technical and scientific terms used herein have the same 
meaning as commonly understood by one of ordinary skill in the art to which this invention 
15 belongs. Although methods and materials similar or equivalent to those described herein can 
be used in the practice or testing of the present invention, suitable methods and materials are 
described below. 

All publications, patent applications, patents, and other references mentioned herein 
are incorporated by reference in their entirety. In case of conflict, the present application, 
20 including definitions, will control. In addition, the materials and methods described herein 
are illustrative only and not intended to be limiting. Other features and advantages of the 
invention will be apparent from the following detailed description, the drawings, and from 
the claims. 

25 Optical Instrumentation 

The methods of the invention use an optical device that acquires spatially co-regis- 
tered electronic images. For example, the optical instrument can be a microscope and digital 
camera. The microscope can be a steady-state, wavelength-scanning fluorescence microscope 
(i.e., not a time-resolved system or not an interferometer-based system). The optical instru- 

30 ment can also provide for background subtraction, spectral overlap corrections, and transfor- 
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mation of data from three channels set into a color space defined by the primary colors of red, 
green, and blue. The transformation of data produces an enhanced image in which FRET, 
acceptor, and donor pixels are more clearly differentiated and pseudocolored accordingly. 

FIG. la is a block diagram showing one embodiment ofa FRET imaging microscope 
for acquiring spatially co-registered electronic images suitable for use with the present 
invention. The structure includes a microscope 1, a detection camera 2, a light source 3, a set 
of three interchangeable epifluorescence cubes 4 (donor, acceptor, and FRET), an image 
processor 5, and an image output device 6. 

In a specific embodiment, the MicroFRET instrument is based on an Olympus BX60 
(upright) or DC70 (inverted) epifluorescence microscope 1. The detection camera 2 uses a 
KAIROS Peltier-cooled charge-coupled device (CCD) camera (Model K7: 16 bit, 760 * 510 
resolution, or Model K8: 1 6 bit, 1340 x 1037 resolution) coupled to the trinocular port of the 
microscope 1 . The detection camera 2 coupling to the microscope is made through a c-mount 
to Olympus U-PMTVC and Olympus U-SPT relay tubes (containing a 2.5 x projection 
eyepiece). The threaded U-PMTVC mount can be adjusted to make the detection camera 2 
parfocal with the oculars. Other hardware components used in this study include a 1 OX/0.40 
objective (U-plan apo infinity/0.17). 

The light source 3 for excitation illumination can be provided by a 75 watt quartz 
tungsten halogen (QTH) light source coupled directly to the microscope 1, although other 
light sources may be used if desired. Exposure time is controlled by an electronic shutter in 
the detection camera 2. Typical exposure times are 0. 1 5-2 seconds. The use of low light 
doses in imagery was enabled by rninimizing exposure time and intensity, using extremely 
sensitive CCD cameras, and by carefully selecting epifluorescence cubes 4 with broad band 
emission filters and narrow band excitation filters. Spectral deconvolution algorithms readily 
correct for the broad-band emission filters. 

FIG. lb is a diagram of an epifluorescence filter cube 4. Each epifluorescence cube 4 
includes an excitation filter 10, an emission filterl 1, and a dichroic mirror 12. The excitation 
filter 10 is a band pass or high pass filter that allows only short wavelength light from a light 
source to pass through. The emission filter 1 1 is a band pass or low pass filter that passes 
only long wavelength light emitted by the object in response to illumination by the shorter 
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wavelength exciting light. The dichroic mirror 12 is a beam splitter that reflects the exciting 
light onto the object and then allows emitted light from the object to pass through. The "cut 
on" wavelength of the dichroic mirror 12 generally lies between the transmission bands of the 
excitation filter 10 and the emission filter 1 1 in a simple configuration. 

The methods of the invention use epifluorescence cubes 4 which have been machined 
to precise tolerances, so that spatial co-registration is maintained for all of the images. This 
design also makes it feasible to detect relatively small amounts of FRET within a given 
image pixel, because the mathematical correction is much simpler (and therefore more 
accurate) than was previously possible. The epifluorescence cubes 4 are precisely milled and 
fabricated, such that there is less than 5 arc seconds deviation between the two planar 
surfaces of each of the dichroic mirrors and emission filters in the epifluorescence cubes. 
This low deviation between the two planar surfaces of each of the dichroic mirrors and 
emission filters results in a high degree of image registration. Because image registration and 
distortion are highly dependent on exact surface parallelism within the dichroic and emission 
filters' surfaces, the dichroic and emission filters of all three cubes were measured for surface 
parallelism (using an autocollimator) and for surface flatness (using an interferometer) and 
found to be less than or equal to 15 arc seconds of wedge parallelism and approximately 10 
waves flatness. Epifluorescence cubes having suitable characteristics were manufactured by 
Chroma Inc. (Brattleboro, VT) to the specifications of less than 2 waves flatness and 5 arc 
seconds wedge. Lesser quality epifluorescence cubes can be corrected by optical centering 
adjustment (OCA) devices (from Olympus of Huntington, NY) in conjunction with donor 
(D), acceptor (A), and FRET (F) cubes to co-align images in run time using a 
focusing/alignment acquisition loop implemented in software. The target can be a fluorescent 
bead (size = point source) visible in all three channels and aligned to one pixel in co-registra- 
tion among the three channels. This is a novel use of OCA's for FRET. Preferred epifluore- 
scence cube specifications are described in TABLE 1. 
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TABLE 1 




Spectral characteristics of epifluorescence cubes. Wavelengths (nm) are 
given as cut-on and cut-off (50% peak transmission) for excitation and 
emission filters, and as the inflection point for dichroic filters. 


Cube/Channel 


Excitation 


Dicbroic 


Emission 


Donor/C, 


335 - 380 


410 


435 - 490 


Acceptor/C, 


450 - 490 


495 


505 - 550 


FRET/C, 


335 - 380 


410 


505 - 720 



The C, channel (arbitrarily assigned to Blue) was designed to selectively excite and 
image donor (D) emission, the C 2 channel (arbitrarily assigned to Green) was designed to 
selectively excite and image acceptor (A) emission, and the C 3 channel (arbitrarily assigned 
to Red) was designed to visualize FRET (F) emission, since excitation was at the donor 
excitation and imaged at the acceptor emission. 

Conventional epifluorescence cubes may be replaced by Fluorescence Imaging 
Micro-Spectrophotometer (FIMS) technology or other methods which do not use a set of 
three fixed-wavelength devices. In FIMS, the emission filter is continuously variable and the 
excitation wavelength can be selected by another device, such as a monochromator. A 
description of the FIMS technology is set forth U.S. Patent Application No. 08/833,351, filed 
2/10/98, entitled "Optical Instrument Having a Variable Optical Filter", and assigned to the 
assignee of the present invention. 

The image processor 5 may be a suitably programmed personal computer. The image 
output device 6 may be a computer monitor (e.g., CRT or LCD display) or a printer. In 
operation, a monochrome image of an illuminated sample is taken by the detection camera 2 
through the microscope 1 and input into the processor 5 as a digitized pixel image. A set of 
three such images from each channel (donor, acceptor, and FRET) can then be processed as 
three spatially coregistered images or treated as a single image in which each pixel has three 
color space coordinates corresponding to the monochrome wavelengths. 

The method of the invention is not limited to an epifluorescence microscope. 
Macroscopic lens-based systems could be used in place of the microscope's objectives to 
achieve FRET detection and quantitation over a macroscopic field of view, such as a 
microliter tray or petri dish (in biology), or a solid state device (in materials science). 
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FRET Physics 

The FSrster equations, which are the basic equations describing FRET, involve 
expressions for the energy transfer rate constant (k,), the transfer efficiency (E), the so-called 
Forster radius or critical distance (R,, in cm), the spectral overlap integral (J (A.)) and the 
normalized fluorescence emission spectrum of the donor (f (X)): 



r is the center-to-center distance (in cm) between the donor and acceptor chromo- 
phores, -c,, is the fluorescence lifetime of the donor in the absence of energy transfer, k 2 is the 
dipole-dipole orientation factor, Q D is the fluorescence quantum yield of the donor in the 
absence of the acceptor, n is the refractive index of the intervening medium, F D (A.) is the 
fluorescence emission intensity of the donor at a given wavelength A (in cm), and 6 A (A.) is the 
extinction coefficient of the acceptor chromophore (in cnf'M" 1 ). J(A.) therefore expresses the 
normalized fluorescence spectrum of the donor and has units of M"'cm 3 . 

For randomly oriented molecules separated by a distance r, when r = /? 0 , the effi- 
ciency of energy transfer is 50%, and the donor fluorescence lifetime is reduced by a factor of 
2. Values of R 0 are on the order of tens of Angstroms. FRET efficiencies fall-off at an inverse 
6* power of distance as normalized by R 0 . Doubling the distance between donor and acceptor 
molecules from R 0 to 2R 0 decreases the FRET efficiency from 50% to approximately 1% 
because of the inverse-e* power dependence: (0.5) 6 . Thus, FRET is a very useful tool for 
determining whether two molecules are in close proximity. This is especially true in the case 
of interacting macromolecules, where molecular radii are similar in size to the actual R 0 
values of their fluorescent tags. 

The extent to which the donor emission is quenched by the acceptor can be used to 
calculate the FRET efficiency E according to one of FOrster's equations: 



k, = (R 0 /r) 6 (l/t <1 ) 
E = [l+(r/R 0 ) 6 ]" 1 
R„ = [8.79 x 10" J(A.)K 2 Q D n- 4 ] 
WM/W e A (A.) \*dk 
f(A) = F D (A.)dX/;F D (X)dA 



1/6 



(1) 

(2) 
(3) 
(4) 
(5) 
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E _ I D- I DA (6) 

where I D and I DA are the fluorescence intensity of the dqnor in the absence and 
presence of acceptor, respectively. This is equivalent to determining the concentration of 
donors performing FRET, divided by the total concentration of donors. 

For most cell biologists, a useful measurement is the relationship of E to r within a 
color-coded image. The invention provides simple models to convert E to the donor-acceptor 
distance (r). 

Correcting Spectral Overlap 

In one embodiment, the inventive method corrects for spectral overlap between the 
donor and acceptor channels (selected excitation and emission wavelength ranges, see supra) 
The mathematical basis for the spectral overlap corrections is provided as follows: 

v-y 

(7) 

where A" can be substituted by "D", "A", or "F* to indicate an image pixel from one of 
the monochrome fluorescence images acquired through the Donor, Acceptor or FRET 
channels, respectively. The subscript "u", can be substituted by "d", "a" or "f * to represent a 
pixel from either a donor, acceptor or FRET bead in the image. Since there is substantial 
spectral overlap, more than one bead type can be seen in each unprocessed channel (FIG. 3). 
The superscript "y", in the equations (8) and (9) below, is replaced by "b" to indicate that the 
monochrome image has been background subtracted before spectral overlap corrections are 
performed. 



ratio of FRET channel intensity to Donor channel intensity for a "pure 
donor" pixel after background subtraction on each monochrome 
image. (8) 



ratio of FRET channel intensity to Acceptor channel intensity for a 
"pure acceptor" pixel after background subtraction on each mono- 
chrome image. (9) 
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These ratios are the fractional "bleed" or spectral overlap of donor and acceptor, 
respectively, into the FRET channel. They are then used to correct the FRET channel pixel 
intensities. Each pixel in the corrected FRET channel image (F *) is given by: 

F r = F 4 - (F„ 4 /Z)» )x D" - (F.» /A b a )x A" 



(10) 



After background and spectral overlap corrected monochrome images are obtained for 
each channel, the three images are combined into a composite RGB image to create a 
corrected FRET image. In the illustrated embodiment, the donor channel is not corrected for 
acceptor bleed and the acceptor channel is not corrected for donor bleed because these effects 
are minimal. 

The correction for spectral overlap is performed as follows: The ratio of the FRET 
channel intensity to the donor channel intensity is determined for a "pure donor" pixel after 
background correction. The ratio of the FRET channel intensity to the acceptor channel 
intensity is also determined for a "pure acceptor" pixel after background correction. These 
ratios are then used to correct the FRET channel values for each pixel. 

Orthonormalization 

In one embodiment, the method uses orthonormalization to convert donor, acceptor, 
and FRET signals into unique colors. For example, the donor, acceptor, and FRET signals are 
converted to B(lue), G(reen), and R(ed). An orthonormalization procedure which qualita- 
tively enhances the corrected image is described below. 

In addition to the spectral overlap algorithm given above, the image can be further 
enhanced by the construction of RGB images based on an orthonormalization transformation. 
This process results in the FRET, acceptor, and donor pixels being pseudocolored by pure 
primary colors: red, green, and blue respectively. To do this, selected pixel values from each 
of the previously processed monochrome images can be used to construct a 3 * 3 matrix, 
referred to as the A matrix: 
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Monochrome Image 
(Grayvalue Image) 



Selected Pixel 



f 
a 
d 



F 


A 


D 




A„ 


A 12 


A,3 




A 21 


A H 


A a 




A3, 


A32 


A33 


= [A] 



(11) 



Columns in [A] represent the three previously processed monochrome images and 
rows represent selected pixels. For example, A,, is equal to a pixel value in the FRET image 
which corresponds to the location of a FRET bead. A 12 and A, 3 are equal to the pixel value in 
the acceptor and donor images, respectively, at this same position. 

The goal of the orthonormalization operation is to transform the A matrix into the 
following matrix: 

Monochrome Image 
(Grayvalue Image) 



Selected Pixel 



f 
a 
d 



F 


A 


D 


c„ 


0 


0 


0 




0 


0 


0 


C33 



= [C] 



(12) 



Where C,„ C 22 and Cj 3 are set to the maximum possible pixel value. The transforma- 
tion can be expressed as follows: 

[A][B] = [C] (13 ) 
Knowing [A] and [C], the B matrix can be determined by multiplying both sides of 
the equation (13) by the inverse of A: 

[A]-'[A][B] = [B] = [A]-'[C] (14) 
The A matrix can be inverted, provided that the selected pixels define independent 
axes. Once the B matrix has been determined, each RGB pixel value triad is multiplied by the 
B matrix to determine the new triad. The transformation may cause some grayvalues to be 
negative, so their absolute value is always used. The transformation may also cause gray- 
values to exceed their maximum possible value. Accordingly, all of the new grayvalues are 
scaled so that the maximum gray value in the RGB image is equal to the maximum possible 
grayvalue. This completes the purification process. 
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In terms of process steps, orthonormalization may be performed by: 

(1) Selecting at least two image regions in an initial image, each image region . 
including at least one pixel, wherein the image regions define at least two distinguishable 
spectral categories. 

(2) Performing a color space transformation such as orthonormalization on the initial 
image, based on the color space coordinates of the pixels in each of the selected image 
regions, to generate a processed image. (If desired, orthonormalization may be performed 
serially on a dynamic series of initial images, or a series of acquired digitized images can all 
be corrected simultaneously). 

(3) Evaluating the processed image for a visible indication of an improved spatial 
distribution of color. The step of evaluating may be based on the improved spatial distribu- 
tion of colors properly segregating to known standard targets, or the improved spatial 
distribution of colors segregating to biological structures. Preferably, a confocal microscope 
is used to perform such evaluation in order to observe three-dimensional spatial information. 

The orthonormalization step is useful to cell biologists who may reiteratively select 
candidate pixels as representatives of the donor, acceptor, and FRET. This human interven- 
tion could be a key component in extracting data from images: the quality of the pixel 
selection would be evaluated by the resulting morphology of the pseudocolored image. For 
example, if FRET is observed within a particular structure after the spectral overlap correc- 
tion, it might be advantageous to test various pixels within this structure by re-selecting 
candidate "red" pixels. 

These algorithmic methods (whether involving imaging or not) may be adaptable to 
flow cytometry (including imaging-in-flow methods) or sorting of cells in a flow system. 

Quantitative FRET Measurements 

In one embodiment, the quantitative method of the invention performs quantitative 
FRET measurements and analyses. FRET image data is obtained with standard filter sets in a 
fluorescence microscope. One set of equations for quantitative FRET is provided below 
(equations 15a-30). These equations are similar to or derived from FRET correction equa- 
tions set forth in Gordon, et al, Quantitative Fluorescence Resonance Energy Transfer 
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Measurements Using Fluorescence Microscopy, Biophysical Journal, Vol. 74, May 1998 
2702:2713, which is hereby incorporated by reference. The two and three letter symbols used 
in the equations have the following meanings: 

Aa is the signal from an acceptor-only specimen using the acceptor filter set; 

Dd is the signal from a donor-only specimen using the donor filter set; 

Fa is the signal from an acceptor-only specimen using the FRET fiher set; 

Fd is the signal from the donor-only specimen using the FRET filter set; 

Ad is the signal from a donor-only specimen using the acceptor filter set; 

Da is the signal from an acceptor-only specimen using the donor filter set; 

Df is the signal from an 'acceptor plus donor' specimen using the donor filter set; 

Ff is the signal from the 'acceptor plus donor' specimen using the FRET filter set; 

Afis the signal from an 'acceptor plus donor* specimen using the acceptor filter set; 

Dfd refers to only the donor signal with the Donor filter set when both donor and 
acceptor are present; 

Dfa refers to only the acceptor signal with the Donor filter set when both donor and 
acceptor are present; 

Ffd refers to only the donor signal with the FRET filter set when both donor and 
acceptor are present; 

Ffa refers to only the acceptor signal with the FRET filter set when both donor and 
acceptor are present; 

Afd refers to only the donor signal with the Acceptor filter set when both donor and 
acceptor are present; 

A/a refers to only the acceptor signal with the Acceptor filter set when both donor and 
acceptor are present; 

D~Td~ refers to the donor signal with the Donor filter set that would have been if no 
acceptor were present and therefore no FRET occurred; 

Afa refers to the acceptor signal with the Acceptor filter set that would have been if 
no donor were present and therefore no FRET occurred. 

The FRET symbols used in the following equations have the following meanings: 
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FRET I is the loss of donor signal due to FRET using Donor filter set in the method 
using three-filter sets; 

FRETN is the normalized measure of FRET equal to FRETlf0Jd~ x Aja); 
FRET2 is equal to FRETl/DJdT, 

FRET3 is equal to FRETl/(DJ r T^ Aja), which equals FRETN; 
FRET4 is the loss of donor signal due to FRET using Donor filter set in the method 
using two-filter sets; 

G is the factor relating the loss of donor emission due to FRET in the Donor filter set 
to the gain of acceptor emission due to FRET in the FRET filter set. 

Note that in a two-filter system, the following substitutions may be made: 
Dd' is similar to Dd but with acceptor concentration proportional to donor concentra- 
tion; 

Fd ' is similar to Fd but with acceptor concentration proportional to donor concentra- 
tion; 

Ad ' is similar to Ad but with acceptor concentration proportional to donor concentra- 
tion; 

Da ' is similar to Da but with acceptor concentration proportional to donor concentra- 
tion; 

Fa ' is similar to Fa but with acceptor concentration proportional to donor concentra- 
tion; 

Aa ' is similar to Aa but with acceptor concentration proportional to donor concentra- 
tion. 

Additional corrections for F can be derived from equations 15a-30 below, where 
equation (10) is rewritten in the terms defined above as equation (15): 

F c = Ff- Df(FaVDd) - Af(Fa/Aa) (15) 

In particular, F can be (1) corrected for cross-talk resulting from detection of donor 
fluorescence through an acceptor emission channel and/or acceptor fluorescence through a 
donor emission channel (e.g., corrected for non-zero values of Ad and Da); (2) normalized for 
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the concentration of a donor, preferably by applying a correction of \IDf\ (3) normalized for 
the concentration of an acceptor, preferably by applying a correction of \IAf\ (4) normalized 
for the concentration of a donor and an acceptor, preferably by applying a correction of 
\l{Pj*Aj)\ (5) corrected for cross-talk and normalized. In addition, the initial FRET image is 
improved with respect to photobleaching by using a sensitive camera and fast exposure times. 



WO 98/55026 



PCT/US98/11390 



Df = Dfd + Dfa 

Ff = Ffd + Ffa 

Af = Afd + Afa 

Df = Dfd + Ffa(Da I Fa) 

Ff = Dfd (Fd I Dd) + Ffa 

Af = Dfd(Ad I Dd) + A/a 

Dfd = D~fd - FRET\ 

Afa = ~Afa + G- FRETl{Ad I Fd) 



G= QY a <f> e T F 



Ffa = ~Afh{Fa /Aa)+G- FRETl 

Dfa = Afa(Da / Aa)+G- FRETl {Dal Fa) 

Df = D~fd- FRETl + ~Afa{Da / Aa)+G- FRETl{Da I Fa) 

Ff = {5fd- FRETlfFd /Dd) + Afh{Fa / Aa)+G- FRETl 

Af = (5fd - FRETl^Ad IDd)+Afa + G- FRETl{Ad I Fd) 

Af-(Ad/Fd)Ff 
l-{FalAa\AdlFd) 

FREn = Ff - (Fd/Dd)Df - Afa[(Fa/Aa)-(Fd/DdXDa/Aa)] 

G[l - {Da I Fa\Fd I Dd)] 

DfeI = Df + FRETl[l - G{Da I Aa)]- ~AJd{Da I Aa) 



(15a) 

(15b) 

(15 c) 

(16a) 

(16b) 

(16c) 

(17) 

(18a) 

(18b) 

(19) 

(20) 

(21a) 

(21b) 

(21c) 

(22a) 
(22b) 

(22 c) 
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c-pittv FRETl [bound] 

FRETN = oc 1 w J , (2V\ 

Dfd-Afa [total d]- [total a] K ' 

K a, = [bound ]/{[free d]- [free a]) (24) 



FlfFn ^ rf-t>AFd/Dd)-Af(Fa/Aa) 
G-Df-Af 



(25) 



Df = Dfd-Dfd- FRET2 + AfaiDa I Aa)+ G-D/d • FRET2(Da I Fa) (26a) 

Ff = (p/d-Dfl- FRETl\Fd I Dd) + ~Afa{Fa /Aa)+G-DJd- FRET2 (26b) 

Af = (p/d-D/d- FRETl\AdfDd) + A/h + G-DJd- FRETl[Ad I Fd) (26c) 

w Af-(Ad/Fd)Ff 

J \-[{AdlFdjFa/Aa)) ( 27a ) 

FRFT2 - Ff ~ ^ Fd 1 D ^ Df ~ ~^i Fa IAa)-{FdJ Dd\Da I Aa)\ 

_ Ff[\ - {Da /Fap\- Df[{Fd I Dd) - G] (27b) 
- Afa[{Fa I Aa) - {Fd I Dd\Da I Aa)] 

FRETN = FRET2I ~Afh (28) 

Df = ~Dfd - ~Dfd • ~A~fh • FRET3 + ~AJa\Da / Aa)+G- DJd • ~AfH • FRET3{Da I Fa) (29a) 

Ff = {pjd - ~Dfd • ~Afh • FRET3^Fd I Dd)+ ~A/d{Fa I Aa) + G • D~fd ■ A~fd • FRET3 (29b) 

Af = $fd-~Dfd- Aja~-FRET3\Ad /Dd)+Afh + G-DJd-AJh- FRET3{Ad I Fd) (29c) 

FRETN = FRET3 = FRET2 1 ~Afa = FRETl I^Dfd ■ Afh) (30) 
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FRET Beads as Calibration Standards 

The invention provides a set of calibration targets, including a variety of 'TRET 
Beads" applicable to widely-used FRET pairs. The invention also provides a method for 
imaging the FRET standards in a conventional three-channel (tx., three-cube) epifluore- 
scence microscope, and applying FRET calibration algorithms such that donor concentration 
[D], acceptor concentration [A], and FRET efficiency (E) values can be determined on 
unknown samples. An advantage of using surfaces such as beads as FRET calibrants, rather 
than solution-based techniques, is that the use of surfaces such as beads eliminates unwanted 
interference by various physico-chemical phenomena, such as singlet-singlet annihilation. 
Other effects may accentuate FRET on surfaces as excitons are formed. 

In one embodiment, the invention provides FRET Beads with His-tagged GFP 
derivatives to Ni/NTA derivatized Sepharose beads at a surface concentration that is 
sufficiently high to achieve efficient FRET between donor and acceptor molecules, e.g., 
between blue-emitting (BFP) and green-emitting GFP derivatives. These FRET Beads 
provide a surface to associate (bind) these His-tagged proteins very tightly in aqueous 
solution (stable for months at 4 °C); however, protein dissociation and release from the bead 
can be accomplished immediately by the addition of imidazole. Release from the bead 
modulates the FRET properties of donor and acceptor molecules {i.e., FRET efficiency goes 
to zero). This treatment can be performed in the same fluorimeter cuvette; the difference in 
spectra taken before and after release is a direct indication of FRET efficiency. Previously, 
FRET parameters were extremely difficult to obtain; for example, artifacts can be generated 
by alternative procedures such as loading highly concentrated donor and acceptor solutions 
into microcapillaries. The invention of a FRET Bead with selective release makes these 
parameters trivial to measure. The simple procedure of adding 1 M imidazole enables 
accurate determination of donor and acceptor concentrations and efficiency, thereby furnish- 
ing the basis for calibration standards in quantitative FRET microscopy. These calibrated 
beads are used to determine instrument response and to standardize the epifiuorescence 
microscope hardware and software for use with a variety of samples. 

In one embodiment, the invention provides a series of FRET Beads bearing deriva- 
tives of the Green Fluorescent Protein that are of current interest to cell biology. These 
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include a blue/green pair (380 nm excitation/5 10 nm emission) and a cyanTyellow" pa i r (450 
nm excitation/530 nm emission). 

Two derivatives of GFP are used for FRET standards, based on their spectral 
properties. The mutant BFP1 1, constructed by Lossau et al. (Chem. Physics. 213:1-16, 1996) 
using combinatorial mutagenesis, contains the mutations F64M/Y66H. BFP11 has blue- 
shifted excitation and emission maxima relative to wild-type GFP (Figure 2). The mutant 
RSGFP4 Pelagrave et al. , Bio/Technology, 1 3 : 1 5 1 - 1 54, 1 995), generated by combinatorial 
mutagenesis, contains the mutations F64M/S65G/Q69L. RSGFP4 has spectral properties 
similar to the S65T mutant reported by Heim et al. (Proc. Natl. Acad. Sci. USA 91:12501- 
12504, 1994). As the acceptor in a FRET pair, both S65T and RSGFP4 are superior to other 
red-shifted excitation mutants such as RSGFP8 (F64L + S65T), because the latter mutant has 
significant excitation in the violet. 

Calibration values can be stored on a computer for future normalization and correc- 
tion of samples that do not include calibration standards (i.e., pure donor, acceptor, or FRET 
Beads) in the same field of view. Once calibrated for a particular pair of fluorophores 
matched to a specific set of cubes within a defined optical bench, these normalization factors 
are stable and applicable to unknowns containing these fluorophores. 

FRET Beads provide a vehicle enabling one to relate a measured intensity of acceptor 
fluorescence sensitization to a corresponding amount of donor quenching. This calibration 
factor, X F , embodies not only instrument response but also the concept of a FRET quantum 
yield. X ? greatly simplifies the determination of the amount of donor performing FRET 
without the need to photodestruct or otherwise physically separate donor from acceptor. This 
calibration factor also compensates for differences in absorption cross-sections, excitation 
intensities, and detection efficiencies. 

By combining the E value determined by conventional fluorimetry measurements of E 
and quantitative imaging, X F is derived from a FRET calibration bead: 



FRET channel after spectral overlap corrections have been made using equation (38), below. 




(34) 



where C, is the intensity from the C, channel and C 3 ' is the intensity from the C 3 
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This value can then be applied to the calculation of FRET parameters in sample unknowns. 
From equation (6), E is equivalent to determining the number of donors performing FRET, 
divided by the total number of donors. Since the FSrster equations apply to a single donor- 
acceptor pair, the amount of donors performing FRET can be directly related to the measured 
sensitized acceptor emission. In the three-cube microscope system, E of FRET samples can 
be determined by incorporating the bead calibration factors (X D and X F ) and combining the C, 
and C 3 channel information as: 

H x +H\ (35) 



E = 



X X 
where F and 0 respectively. 

Thus equations (34) and (35), used in conjunction with FRET Beads, greatly facilitate 
the conversion of sensitized acceptor emission into units compatible with quenched donor 
emission, resulting in the ability to readily quantitate the amount of donor performing FRET, 
the total amount of donor, and the FRET efficiency. 

For the beads shown in FIG. 8, from the y-axis values, I D = 0.63 and I DA = 0.24. The 

energy transfer efficiency E is determined by substituting into equation (6): 

E = 0.63 - 0.24 = 0.62 (i.e., 62% efficient in energy transfer) 
0.63 

Measurement of £ enables the mean separation distance (r) between donor and 
acceptor to be calculated using another one of the Forster equations: 

E (36) 

where R„ is the Forster radius or critical distance at which the efficiency of energy 
transfer is 50%. Rocan be determined using semiempirical methods and the following (see, 
equation (3)): 

R o =[8.79xl0- 25 J(A)K 2 Q D n- 4 ]" 6 (37) 
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Parameters in equation (37) include J, the spectral overlap integral, which is graphi- 
cally equivalent to the integrated area shared between the donor's fluorescence emission 
spectrum and the acceptor's ground state absorption spectrum, both normalized to unity. 
Other parameters include: Q D , the fluorescence quantum yield of the donor in the absence of 
acceptor, n, the index of refraction, which for a cellular system is typically (1.3 - 1.4); k 2 , the 
dipole-dipole orientation factor. Considering the spectral overlap for the BFPl 1/RSGFP4 pair 
shown in FIG. 8, and random orientation factors, R^is approximately 40 A. Substitution of R<, 
and E into equation (36) results in a separation distance r of 37 A between BFPl 1 and 
RSGFP4 on the FRET Beads described above. This BFPl 1-RSGFP4 distance is reasonable 
considering that the minimum possible distance between the fluorophores is ~25 A, as 
indicated by the X-ray structure of the GFP dimer. 

The invention also provides a method to characterize (by conventional fluorimetry) a 
series of beads with controlled quantities of donor and acceptor molecules per unit surface 
area so as to generate standards with respect to donor concentration [D], acceptor concentra- 
tion [A], and FRET efficiency (E). The determination of donor intensities in the presence 
(Ida) absence (I D ) of FRET, which are normalized for donor concentrations, is one of the 
major difficulties in performing quantitative FRET on biological samples. Imidazole 
mediates the release of the GFP fluorophores from the Ni/NTA-chelating bead to achieve this 
in essentially one step. 

The existence of spectral overlap is noted by observing that each of the monochrome 
images shows more than one bead type. In the C 3 channel, spectral overlap is a result of 
bleed-through of the donor's emission tail into the acceptor emission band. In addition, direct 
excitation of the acceptor can occur at certain wavelengths (e.g., 370 nm) due to a small 
amount of acceptor absorbance at such wavelengths. Spectral corrections for the C 3 channel 
can be made by adapting equation ( 1 0) as follows: 

c J / =c J -(c J fl /c l Vc I -(c, x /c ! i )xc 1 < 38 ) 

C° IC° 

where 3 1 = the ratio of the FRET channel intensity to the Donor channel 
intensity for a "pure donor" pixel after background subtraction on each monochrome image, 



-24- 



WO 98/55026 



PCT/US98/11390 



C* I C A 

and 3 ! = the ratio of the FRET channel intensity to the Acceptor channel intensity for a 

"pure acceptor" pixel after background subtraction on each monochrome image. 

Having derived the fluorophore surface concentrations from solution measurements 
{see, equation (40)), donor surface concentrations can be related to the donor emission 
intensity in C, images of pure donor beads via the following equation: 

where X D is defined as the donor calibration factor and has units of grayvalue per 
molecule per unit area. Likewise, the acceptor calibration factor, X K , can be determined from 
pure acceptor beads imaged through the C 2 channel. Since a three dimensional fluorophore- 
coated bead is projected onto a two-dimensional imaging surface, care must be taken in 
selecting pixels to be used for intensity (grayscale) measurements. Given the size and optical 
density of these beads, it is reasonable to base intensities on the center pixels of each bead 
and divide by a factor of 2. This is because looking down on a bead in the microscope, 
fluorescence (which is isotropic) is seen from both the bottom and the top of the bead surface 
due to the 3D to 2D projection. In determining X A and X D it is important to note that the 
fluorescence quantum yield and instrument response corrections are all embodied within this 
calibration factor. By constructing and characterizing a series of beads, the linearity of this 
relationship or the limits of the linear range are determined. 

By calibrating the instrument, other factors that influence FRET intensity can be 
experimentally determined, e.g., the interchromophore separation (r), the orientation factor 
(k 2 ), and the FRET efficiency (E). These calibrations may enable the user to create images in 
which the magnitude and spatial distribution of these coefficients are displayed. Values for 
the first two variables could be determined by adding, for example, corrections for dif- 
ferences in absorption cross section between donor and acceptor, and corrections for 
differences in excitation intensity and detector efficiency. Values for k 2 can be determined by 
using calibration standards containing chromophores with fixed orientations. 
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Calibration and Test Samples 

In a typical analysis, three images using C„ C 2 , and C 3 are obtained for a calibration 
slide bearing a mixture of pure donor, pure acceptor, and FRET beads. Fluorescent beads are 
air-dried on the surface of a microscope slide for imaging. All images recorded used light- 
minus-dark subtraction to correct for a pedestal of dark counts. The calibration slide is then 
used to obtain the background-subtracted, spectral overlap correction ratios as well as X A , 
X D , and X F . After these measurements are made, this slide is removed and replaced with a 
test sample from which three additional images are obtained under identical experiment 
conditions. Each of these monochrome images is background subtracted and the overlap 
corrections applied. The image-based microscope system performs massively parallel 
analysis on every pixel in the scene. For a 1000 X 1000 resolution image, this is equivalent to 
lO 6 simultaneous single spot measurements. Each pixel can be processed to generate energy 
transfer efficiency according to equation (35) and distance distribution images according to 
equation (36), provided that R„ is known. [A] images can be determined from the ratio of the 
C 2 channel to X A , and [D] images can also be derived. 

Once the microscope is calibrated for a specific FRET pair, the system remains 
calibrated for all other samples containing those types of fluorophores. Recalibration is 
required only if the microscope's hardware is altered (e.g., changing an epi-cube) or if a 
different FRET pair is studied. 

Quantitation of FRET signals can be achieved by correlating measurements made in 
the MicroFRET device on beads or other targets with conventional measurements made in a 
fluorimeter. For example, imidazole release of fluorophores from the beads within a cuvette 
can be used to quantify total donor and acceptor, as described in EXAMPLE 2. 

Computer Implementation 

The MicroFRET system provides digital imaging spectroscopy (DIS) software that 
supports algebraic manipulation of images for correcting bleed-through of donor emission 
into the acceptor channel and for correcting excitation of the acceptor at the donor excitation 
wavelength, as well as for creating a new RGB axis-set to highlight donor, acceptor, and 
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FRET pixels. The system also provides image processing and display for both 16-bit 
monochrome images and 24-bit RGB images. 

Correction for spectral overlap was performed as follows: The ratio of the FRET 
channel intensity to the donor channel intensity is determined fbr a "pure donor" pixel after 
background correction. The ratio of the FRET channel intensity to the acceptor channel 
intensity is also determined for a "pure acceptor" pixel after background correction. These 
ratios are then used to correct the FRET channel values using equation (10) for each pixel. 
After a grayvalue image has been obtained for each of the three channels, the three measure- 
ments are reassembled into a composite RGB image. However, even though the correction 
factors for spectral overlap have been calculated for each of the three channels, the various 
donor, acceptor and FRET beads do not necessarily appear as pure blue, green and red, 
respectively, because the colors displayed in the initial RGB image have not yet been 
orthonormalized. MicroFRET allows the user to correct this problem by permitting a user to 
select pixels that contain the most red, green and blue from the overlap-corrected RGB 
image. The program mathematically transforms the image to a color system in which the red, 
green and blue axes are defined by the red, green and blue grayvalues for the pixels that have 
been selected (FIG. 4). 

More particularly, the algorithm that is used in MicroFRET transforms an RGB image 
from the red, green and blue color system into a color system defined by three user-defined 
RGB triads. A composite RGB image has already been described in FIG. 3, and reproduced 
as panel A in FIG. 5. The FIG. 5 panels are magnified so that only the upper left quadrant of 
the FIG. 3 image is shown. Steps in the bleed correction and the orthonormalization of the 
uncorrected RGB image shown in FIG. 5 (panels A - F) proceed as follows: 

Panel 5 A - RGB. The monochrome images from FIG. 3 were combined to generate 
panel 5A using images shown in windows Dl, Al, and Fl for the blue, green, and red 
channels, respectively. The color intensity range for all three color channels is based on the 
minimum and maximum pixel values of the combined three-image set. 

Panel 5B - Scaling corrections. Fluorescence signal intensities among the three 
channels can vary due to quantum yield and extinction coefficient differences between donor 
and acceptor. Signal strength is also dependent on instrument parameters such as illumination 
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intensities of the light source and detector sensitivity at different wavelengths. If the range of 
pixel values differs significantly between channels, the color of the channel with the highest 
pixel value readings can overwhelm the color of the channel with lower pixel value readings. 
Panel 5B shows the pseudocolor image after individually reselling the color intensity of each 
of the three channels to its minimum and maximum pixel values. 

Panel 5C - Background correction. Panel 5C shows the pseudocolor image after each 
pixel has been corrected for background signals. MicroFRET software prompts the user to 
select the position of five background pixels by clicking on the image. These pixel values are 
averaged and automatically subtracted. If any of the subtracted values are negative, they are 
set to zero. 

Panel 5D - Spectral overlap corrections. The data represented in FIG. 3 showed that 
there is significant spectral overlap among the epifluorescence images. However, because the 
epifluorescence cubes in the MicroFRET instrument maintain precise image registration, the 
contaminating contributions to the FRET image (and the other images) can be subtracted 
from all of the pixels. For the FRET channel, this correction is performed according to 
equation (10) which minimizes donor and acceptor bead pixel values in the FRET channel so 
that they approach zero. Only pixels from beads performing FRET maintain significant signal 
intensity in this channel (red) after correction. Panel 5D shows the pseudocolored image after 
this overlap correction. The "red contribution" from the pure donor and pure acceptor beads 
has been removed. The donor beads now appear blue instead of purple and the acceptor beads 
now appear as green. 

Panel 5E - Highlighting FRET. To further demonstrate the correction for spectral 
overlap, the green and blue channels are turned off in the bleed-corrected image. This 
simplifies the identification of the "red" pixels where FRET is taking place. This process is 
easily performed in real-time using a simple tabbed dialog box in which each tab allows the 
user to selectively contrast enhance a particular channel. As can be seen in panel 5E, only red 
beads corresponding to FRET are observed. 

Panel 5F. Orthonormalization. To enable identification of areas in the sample which 
contain donor, acceptor, or FRET emission, the software can pseudocolor the image based on 
user-defined criteria. By clicking the computer mouse on pixels representing each of the three 
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types of beads (i.e., donor, acceptor, and FRET) in panel 5D, the user can reset the color 
assignments to display corrected emission from the donor to pure blue, the acceptor to pure 
green, and FRET to pure red (panel 5F). 

Computer implementation of this aspect of the invention can be summarized as 
follows: 

1. Select 3 epifluorescence cubes optimized for Donor, Acceptor,- and FRET 
channels. 

2. Optically align cubes to within 1 pixel resolution; if using OCA devices, apply 
run-time software acquisition loop to fluorescent bead visible in all three chan- 
nels to achieve alignment. 

3. Combine images acquired through the three cubes into one RGB image. 

4. Either skip to step 9 or perform steps 5-8. 

5. Orthonormalize the RGB image by selecting pixels representative of donor, 
acceptor, and FRET pixels. 

6. Repeat step 5 if choice of candidate pixels yields poor mapping of color to either 
biological morphology or standards. 

7. Optionally, save orthonormalization template for application to subsequent 
images. 

8. Contrast enhance R, G, and B in the orthonormalized RGB image. END. 

9. Correct the RGB image for background. 

10. Further correct for spectral overlap according to equations related to F c . 

1 1 . Contrast enhance R, G, and B in the corrected RGB image. 

12. Optionally, perform steps 5,6,7,8. 

Aspects of the invention may be implemented in hardware or software, or a combina- 
tion of both. However, preferably, the algorithms and processes of the invention are imple- 
mented in one or more computer programs executing on programmable computers each 
comprising at least one processor, at least one data storage system (including volatile and 
non-volatile memory and/or storage elements), at least one input device, and at least one 
output device. Program code is applied to input data to perform the functions described 
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herein and generate output information. The output information is applied to one or more 
output devices, in known fashion. 

Each program may be implemented in any desired computer language (including 
machine, assembly, high level procedural, or object oriented programming languages) to 
communicate with a computer system. In any case, the language may be a compiled or 
interpreted language. 

Each such computer program is preferably stored on a storage media or device (e.g., 
ROM, CD-ROM, tape, or magnetic diskette) readable by a general or special purpose 
programmable computer, for configuring and operating the computer when the storage media 
or device is read by the computer to perform the procedures described herein. The inventive 
system may also be considered to be implemented as a computer-readable storage medium, 
configured with a computer program, where the storage medium so configured causes a 
computer to operate in a specific and predefined manner to perform the functions described 
herein. 

Examples 

The capabilities of the MicroFRET device are demonstrated in the EXAMPLES by 
employing a pair of two widely used fluorescent protein tags. A wider range of applications 
for this instrument in cell biology studies are possible as more GFP variants with shifted 
excitation and emission spectra are constructed. Other fluorescent molecules and fluoro- 
phores besides GFP derivatives can be analyzed in this instrument by simply choosing an 
appropriate set of epifluorescence cubes, wherein the donor, acceptor and FRET cubes are 
designed to separate these signals based on their excitation and emission spectra. Further- 
more, this system could also be used with non-protein chromophores such as organic dyes or 
lanthanide metals, or with combinations of all of these types. 

The technique of specific fluorophore-to-bead coupling can be extended to include 
other chemistries that do not rely on agarose beads, His-tagging, nickel derivatization, or 
fluorescent proteins. Thus, the beads can have two organic molecules acting as" the FRET pair 
(e.g.. fluorescein and rhodamine) while maintaining the ability to selectively release the 
fluorophores into solution. 
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Accordingly, the following EXAMPLES are illustrative and are not intended to limit 
the scope of the present invention. 

EXAMPLE 1 
FLUORESCENT PROTEINS AND BEADS 

This EXAMPLE outlines a procedure to fabricate FRET calibration standards. This 
involved the synthesis of three types of beads: pure donor, pure acceptor; and FRET beads 
bearing both donor and acceptor molecules. Each bead type was synthesized as a series, 
where the values of [D], [A], and E were varied. To construct this series of beads, a Ni/NTA- 
competitive binder ("S", for spacer) that is His-tagged and has a similar size and shape as the 
donor and the acceptor was used. In the case of GFP derivatives, several nonfluorescent 
mutants have been engineered which exhibit a "null" fluorescence phenotype, but nonetheless 
express large quantities of protein deficient in chromophore {e.g., point mutation R96M). 
Such His-tagged derivatives make excellent spacers on the surface of the Ni/NTA beads 
amongst other spectrally active GFP derivatives. The beads can be loaded with protein 
solutions systematically varied in D, A, and S. 

GFP-adsorbed bead standards were prepared using the following procedure. To 
facilitate protein purification and later attachment on Ni-Sepharose beads, BFP1 1, RSGFP4, 
and the R96M variant were engineered to include His 6 tags on their amino-termini. The 
mutant BFP 1 1 , constructed using combinatorial mutagenesis, contains the mutations 
F64M/Y66H (Lossau et al., Chem. Physics. 213:1-16, 1996) and is similar to the mutant of 
Heim et al. {Proc. Natl. Acad. Sci. USA 91:12501-12504, 1994). It has blue-shifted excitation 
and emission maxima relative to wild-type GFP (FIG. 2 and TABLE 2 infra). The mutant 
RSGFP4, generated by combinatorial mutagenesis by Delagrave et al. (Bio/Technology, 
13:151-154, 1995), contained the mutations F64M/S65G/Q69L. RSGFP4 has spectral 
properties similar to the S65T mutant also reported by Heim et al. {Proc. Natl. Acad. Sci. 
USA 91:12501-12504, 1994). As the acceptor in a FRET pair, both S65T and RSGFP4 are 
superior to other red-shifted excitation mutants such as RSGFP8 (F64L + S65T), because the 
latter mutant has significant excitation in the violet. 
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The proteins were expressed in E. coli strain BL21(DE3), grown for 24 hours, 
ruptured in a French press, applied to a Novagen HisBind purification column, eluted in 1 M 
imidazole, and dialyzed. The final protein concentration was determined by a Bradford assay 
(Bio-Rad). An SDS-PAGE gel was run to confirm the purity and size of the dialyzed fraction 
(data not shown). Fluorescence excitation and emission spectra were recorded on a Photon 
Technology QM-1 fluorimeter. 

HiTrap metal chelating Sepharose beads are charged according to the manufacturer's 
(Pharmacia Biotech) instructions by washing the beads with 50 mM NiS0 4 . The beads are 
then washed extensively with 50 mM Tris-HCl (pH 8.0) to remove traces of uncomplexed 
nickel ions. A solution is made of purified proteins at a total protein concentration of 
approximately 0.4 mg ml' 1 in 50 mM Tris-HCl buffer. This dilute concentration is used to 
avoid GFP dimer formation in solution. 1 .5 ml of this mixture is added to 50 ul of a bead 
slurry and incubated on ice for 1 hour with frequent mixing. Excess protein ensures that the 
beads are fully loaded. To remove nonspecifically bound protein (if any) the suspension is 
washed twice with a buffer containing 5 mM imidazole, 0.5M NaCl and 20 mM Tris-HCl, 
followed by one wash with 50 mM Tris-HCl. All washes are done by centrifuging the beads 
at 1,000 x g for 30 sees, in a microcentrifuge and resuspending the pellet in the appropriate 
buffer. The mean particle size of the beads is approximately 34 um. 

FIG. 6 shows the surface of the chelating bead, as represented by a horizontal black 
line, with GFP donors and acceptors (e.g., BFP and RSGFP) shown as blue and green vertical 
lines, respectively. Six different types of possible interactions are labeled A-F. In this 
drawing, only adjacent molecules are considered to be within an efficient FRET distance. 

The most heavily loaded beads were produced (under saturating conditions) to have 
optical densities under 0.1; therefore, photon-mediated trivial energy transfer or reabsorption 
do not have to be considered. In addition, the bead size is sufficiently large that surface 
resonance effects can be ignored. 
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EXAMPLE 2 
CONVENTIONAL FLUORIMETRY 
ON THE GFP-LABELED FRET BEADS 

5 To confirm that the fluorescence emission from the FRET bead is actually FRET, as 

well as to ensure that the spectral properties of the two GFP variants have not changed as a 
result of binding to the Sepharose beads, a sample of each type of bead was treated with 
imidazole, which releases the protein. Fluorescence emission spectra for the FRET beads are 
shown in FIG. 2 and 8. The thick line of the B panels shows the emission spectrum of a 

10 suspension of FRET beads excited at 370 nm. The thin line of the B panels shows the 

emission spectrum of the same beads after both RSGFP8 and BFP-1 1 have been released 
from the beads by treatment with imidazole. The decreased donor emission and enhanced 
acceptor emission are characteristic of FRET. This effect is reversed when the two proteins 
are released from the beads. 

15 To determine [D] and [A] for each bead in a series, the concentrations of donor and 

acceptor were first measured in solution after release by treating with imidazole. This is best 
performed spectroscopically using known extinction coefficients or against known standards, 
since it is not possible to distinguish D, A and S with simple protein assays. The surface 
concentration of S is unimportant, because it is being used simply as a spacer and has no 

20 spectral properties in terms of visible absorption or fluorescence. After correcting for the 
increase in volume attributable to the addition of the imidazole (typically a factor of 1.25 x 
after adding a 1/4 volume of a 5 M solution), surface concentrations of donor molecules on 
pure donor beads can be determined from the following: 

_ [^jRgjeased In solution 

25 t 5 ^ 2 (40) 

where d is the bead diameter which is given by the manufacturer, or alternatively 
measured using a stage micrometer and known magnification factors. Bead concentration 
([5]) in units of particles per ml, can be determined very accurately using a cell sorter. This 
has already been performed for three bead slurries, which were constructed under saturating 
30 fluorophore conditions. Fluorophore concentration measurements can be made for the pure 
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acceptor and FRET beads using equations similar to equation (40). In the case of FRET 
beads, total donor and total acceptor concentrations can be determined after release. 

EXA M PLE 3 

DATA ACQUISITION FOR GFP-LABELED BEADS 

FIG. 3 shows a set of monochrome images obtained for a mixture of labeled 
Sephadex beads. Individual beads were coated with either (1) BFP-1 1 alone (donor beads), 
(2) RSGFP8 alone (acceptor beads) or (3) a 2:1 mixture of donor and acceptor (FRET beads). 
FIG. 3, lower right, shows the intensity of fluorescence emitted by all of the beads in the 
donor emission channel when excited by light corresponding to the donor's excitation 
spectrum. FIG. 3, lower left, shows the fluorescence emitted by the same beads in the 
acceptor channel when excited by light corresponding to the acceptor's absorption spectrum. 
FIG. 3, upper right, (the "FRET" channel) shows the fluorescence emitted in the acceptor 
channel when excited by light corresponding to the donor's excitation spectrum. The results 
from these monochrome images are displayed together in a pseudocolor image, with the 
fluorescence signal from the donor channel assigned the color blue, the signal from the 
acceptor channel assigned the color green, and the signal from the FRET channel assigned 
the color red (FIG. 3, upper left). In this image, the color intensities in each of the three 
channels are scaled to the pixel (from any of the three channels) with the highest grayvalue 
(DEFAULT setting). The FRET beads appear gold because these beads have fluorescence 
contributions in all three channels. The pure donor beads appear purple (blue-red) because 
these beads have fluorescence contributions from the donor (blue) and FRET (red) channels. 
The pure acceptor beads appear mostly green with a slight reddish color because these beads 
have fluorescence contributions from the acceptor (green) and FRET (red) channels. It is 
evident from these images that there is significant bleed-through of both donor and acceptor 
emission into the FRET channel. 
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EX A M PLE 4 

IMAGE ACQUISITION OF GFP-LABELED BEADS 

Three monochrome images were acquired using the set of three epifluorescence cubes 
{see, TABLE 1,) to image a mixture of three different types of fluorescent beads (described in 
TABLE 2). The epifluorescence cubes and bead types are labeled Donor, Acceptor, and 
FRET to emphasize that the cubes and beads are spectrally matched. The donor bead carries a 
GFP derivative (BFP1 1) with an excitation maximum in the long wave.UV and emission in 
the blue. The acceptor bead carries RSGFP4, which is excited maximally in the cyan and 
fluoresces in the green. These excitation and emission wavelengths are matched to the donor 
and acceptor cubes. The FRET bead carries both the blue and green GFP derivatives, and the 
corresponding FRET cube is optimized to excite the blue donor and image the green acceptor 
after energy transfer has occurred. Images acquired using the Donor, Acceptor, and FRET 
cubes are referred to as the Dl, Al, and Fl images, respectively. 





TABLE 2 




Spectral characteristics of fluorescent beads used in this work. Wavelengths (nm) are 


given as X^. 






Bead / Derivative 


Excitation 


Emission 


Donor /BFP 11 


380 


445 


Acceptor /RSGFP4 


490 


510 


FRET / BFP 1 1+RSGFP4 


380 


510 



Spectral mixing among the donor, acceptor, and FRET beads can be observed in the 
spatially coregistered monochrome and RGB images of FIG. 3. In the Dl image, the donor 
beads are the brightest, but dimmer FRET beads are also observed. In the Al image, the 
acceptor beads are the brightest, but dimmer FRET beads are also observed. In the Fl image, 
the FRET beads are the brightest, but dimmer donor beads are observed. This is consistent 
with the fluorescence spectra shown in FIG. 2 and the parameters given in TABLE 2. The 
pseudocolored, upper left image (RGB1) in Fig. 3 is the result of encoding the pixel values of 
each of these monochrome images into an intensity value for each of the red, green and blue 
components of the image. Fl is loaded into the red color channel, Al is loaded into the green 
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color channel and Dl is loaded into the blue color channel. Because of spectral overlap, the 
various bead types are not visually distinct or well defined in this RGB image. 

Careful observation of the emission spectra of the donor and the acceptor shows that 
there is no wavelength at which the two fluorophores can be separated. For example, the use 
of a very narrow bandpass emission filter at 550 nm would not only fail to separate the two 
fluorophore's emissions, but it would also result in the loss of most of the microscope's light 
gathering ability. Using higher intensity illumination to compensate for this loss is likely to 
result in photobleaching. In contrast, the invention uses broad-band emission filters and a 
relatively low intensity excitation source. 

EXAMPLES 

COLOR-CODED IMAGES OF BACULOVIRUS-INFECTED S19 CELLS 

Baculovirus-infected Sf9 cells expressing BFP1 1, RSGFP4, and a BFP1 1/RSGFP4 
fusion protein were tested (as shown in FIG. 7). After proper calibration of the system using 
FRET Beads, the [D] values are equal to zero in the RSGFP4-infected cells, and [A] values 
are equal to zero in the BFP1 1 -infected cells. FRET efficiencies in the BFP11/RSGFP4 
fusion-protein-infected cells are equal to or less than the efficiency for the isolated fusion 
protein measured in solution, depending on the extent of proteolysis. 

The extent of photobleaching and photoisomerization is less than 5%, as previously 
measured for the MicroFRET system using similar cubes, light sources, and CCD cameras. 

EXAMPLE 6 

MEASUREMENT OF DONOR PHOTOBLEACHING 

Steady-state FRET imaging of cells by sensitized emission using conventional 
microscopy has previously suffered from an inability to correct for spectral overlap while 
maintaining spatial co-registration. Until now, the three epifluorescence cubes (donor, 
acceptor and FRET) that must be used to generate the correction values have been manufac- 
tured with optical surfaces that are not strictly parallel. This defect created geometric 
distortions in the image (i.e., displacement of pixels) after the images were combined. The 
MicroFRET instrument employs epifluorescence cubes which have been machined to precise 
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tolerances, so that spatial co-registration is maintained for all of the images. This design also 
makes it feasible to detect relatively small amounts of FRET within a given pixel because the 
mathematical correction is much simpler (and therefore more accurate) than was previously 
possible. 

The effectiveness of these corrections was demonstrated by obtaining images of 
Sepharose beads loaded with either BFP-1 1, RSGFP4 or a defined mixture of the two (which 
is known to generate FRET). By using these beads as calibration standards, spectral overlap 
was corrected for and features identified within the image displaying donor emission, 
acceptor emission and donor-sensitized acceptor emission (FRET). By subsequently applying 
the orthonormalization algorithm ("pixel purification"), the pure donor, pure acceptor and 
FRET beads were pseudocolored as blue, green and red, respectively. 

Another concern in using the sensitized emission technique has been that the exciting 
light can photobleach the donor and thereby reduce the apparent intensity of the FRET signal. 
The sensitized emission technique does not reduce the FRET signal by more than 5% when 
using the method of the invention. Photobleaching is not a major problem because the high 
sensitivity of the K7 camera makes long exposures unnecessary. The grayscale intensities of 
the fluorescent signals in the experiments, for example, used approximately 1/3 of the total 
dynamic range of the camera (maximum = 65535 bits). Nevertheless, under these exposure 
conditions, less than 5% of the donor signal was photobleached. The exposure time could 
easily be reduced by a factor of 10 and still allow the signal to be detected. 

The maximum extent of photobleaching of the BFP-1 1 donor during a FRET 
measurement was determined by monitoring the intensity of fluorescence emission from a 
sample of donor beads which were repeatedly given 30 sec. exposures to the exciting light. 
The mean grayscale value was determined for ten randomly selected pixels after multiple 
exposures, and these values were compared to the values for the same beads after the initial 
30 sec. exposure. The measured intensity of the fluorescence emission after repeated 
exposure to the exciting light was >95% of the initial level. 
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EXAMPLE 7 
QUANTITATIVE FRET MICROSCOPY 

The purpose of this EXAMPLE is to show that it is feasible to perform quantitative 
FRET microscopy by determining the donor concentration, acceptor concentration, energy 
transfer efficiency, and distance parameters between donor and acceptor molecules for every 
pixel in a microscopic field of view. 

Quantitative Imaging was performed using an Olympus AX70 epifluorescence 
microscope equipped with three cubes matched to the excitation and emission spectra of the 
GFP derivatives (TABLE 3). These cubes were spatially coregistered to single-pixel 
accuracy. Images taken with each cube form the input of three channels, which were used for 
subsequent image processing. The C, channel was designed to selectively excite and image 
donor emission, the C 2 channel was designed to selectively excite and image acceptor 
emission and the C 3 channel was designed to visualize FRET, since excitation was at the 
donor excitation and imaged at the acceptor emission. 





TABLE 3 




Spectral characteristics of epifluorescence cubes used for BFP11/RSGFP4. Wavelengths 


(nm) are given as cut-on and cut-off (50% peak transmission) for excitation and emission 


filters and as the inflection point for dichroic filters. 




Cube 


Excitation (nm) 


Dichroic (nm) 


Emission (nm) 


Donor (BFP11) 


335 - 380 


410 


435 - 490 


Acceptor (RSGFP4) 


450-490 


495 


505 - 550 


FRET 


335-380 


410 


505 - 550 



EXAMPLE 8 

ORTHONORMALIZATION OF CHROMOGENIC DYES 

Color space transformation algorithms are useful for rapidly identifying and highlight- 
ing groups of pixels or features in images which have very subtle or overlapping color 
difference. For example, FIG. 9 shows hematoxylin and eosin (H&E) slides of stained thin 
sections of cardiac tissue including an infarct The left panel shows the true-color image 
generated by combining three separate monochrome images at 450, 550, and 650 nm of the 
H&E stained tissue. The right panel shows this image after orthonormalization. In this 
particular case, candidate pixels for the orthonormalization were picked from nuclei, light- 
OS- 
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colored eosin, and dark colored eosin-containing regions as R, G, and B, respectively. The 
resultant image shows two distinct types of eosinophilic tissue. Such differentiation in 
staining by eosin is difficult to see in non-enhanced images. Subtle color differences in eosin 
may correlate with various disease states such as the presence of collagen in tissues. The 
enhanced image has been further enhanced by contrast enhancement of each separate R, G, 
and B color channel. 

EXAMPLE 9 
CORRECTIONS IN TIME-COURSE IMAGERY 

Candidate pixels or features that are used to calculate the color space coordinates of 
the refined image can be selected from a sequence of spatially coregistered images which 
might, for example, involve a time sequence of events. In this embodiment, a series of images 
would be displayed within a window with 'stop', 'start', 'forward' and 'time-delay' parame- 
ters. While the sequence of images might have been obtained over a very fast time course 
(video rates; milliseconds per frame), the player would enable the end user to slow down the 
visualization process to the extent that candidate pixels would be picked as the basis for the 
color space transformation. Coefficients to these specific transformations would be applied to 
all frames in the image sequence; the heuristics of a user-desired morphology would utilize a 
graphical user interface to evaluate whether the candidate pixels were a good pick. This 
method may be very important in ratio-metric dynamic imaging of live cells, wherein 
movements of protein, ions, and other cellular components are reported through fluorescence 
and FRET. Other evaluation criteria for determining whether the candidate pixels were 
properly chosen include the segregation of colors onto known standard targets. 

The mathematical coefficients determined during the conversion of an unprocessed to 
processed image utilizing an image containing known standards, can be saved and applied to 
an image containing no standards. This standardization template can be recalled and the 
coefficients used to correct subsequent images taken under similar conditions of illumination, 
optical filtration and recording. 
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A number of embodiments of the present invention have been described. Neverthe- 
less, it will be understood that various modifications may be made without departing from the 
spirit and scope of the invention. For example, the invention described above is clearly not 
limited to FRET analyses of GFP derivatives on specific beads; but these experiments do 
demonstrate a reduction to practice of an imaging spectrophotometer and methods capable of 
detecting FRET. Accordingly, other embodiments are within the scope of the following 
claims. 
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WHAT IS CLAIMED IS: 

1 . A method for transforming an initial image of biological material to a processed image, 
the initial image being represented by a set of pixels each having three color space 
coordinates, the method including the steps of: 

(a) selecting at least two image regions in the initial image, each image region including 
at least one pixel, wherein the image regions define at least two distinguishable 
spectral categories; 

(b) performing a color space transformation on the initial image, based on the color 
space coordinates of the pixels in each of the selected image regions, to generate a 
processed image; and 

(c) evaluating the processed image for a visible indication of an improved spatial 
distribution of color. 

2. The method of claim 1, where the color space transformation is an orthonormalization 
transformation, wherein grayvalues of selected pixels are used to construct the matrix 



A„ 


A l2 


A 13 






A 22 


A a 




A„ 


A 32 


A 3J 


= [A] 



which is transformed to the matrix 



c„ 


0 


0 


0 




0 


0 


0 


c 



3. The method of claim 1, where the color space transformation is a spectral overlap 
correction. 
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1 4. The method of claim 1, where the color space transformation is a spectral overlap 

2 correction of the form: 

F< = F" - (F b jD b d )x D b - (fUK )x A b . 

1 5. The method of claim 1, where the image regions include substances that absorb light 

1 6. The method of claim 1, where the image regions include substances that fluoresce. 

1 7. The method of claim 1 , where at least one image region includes a substance that exhibits 

2 FRET. 

1 8. The method of claim 1, where the step of evaluating is based on the improved spatial 

2 distribution of colors properly segregating to known standard targets. 

1 9. The method of claim 1, where the step of evaluating is based on the improved spatial 

2 distribution of colore segregating to biological structures. 

t 10. The method of claim 1, wherein the method for transforming includes using a dynamic 
2 series of initial images. 

1 11. The method of claim 1 , wherein the step of evaluating includes using a confocal micro- 

2 scope. 

1 12. The method of claim 1, wherein the image is within a series of images all corrected 

2 simultaneously. 

1 13. The method of claim 1, wherein the step of evaluating includes using a set of calibration 

2 targets. 

1 14. The method of claim 1, wherein the image is of a stained thin section of tissue. 



-42- 



WO 98/55026 



PCT/US98/11390 



15. A FRET standard, carrying both donor and acceptor molecules, with known FRET 
properties used to a calibrate an optical instrument to enable FRET measurements. 

16. The FRET standard of claim 15, where the FRET property is efficiency E. 

17. The FRET standard of claim 15, where the FRET standard relates a measured intensity of 
acceptor fluorescence sensitization to a corresponding amount of donor quenching 
according to: 



18. The FRET standard of claim 15, where the FRET properties are modulated by association 
and dissociation of the donor and the acceptor molecules. 

19. The FRET standard of claim 15, where the FRET properties of the standard are deter- 
mined by modulating the association and dissociation of the donor and the acceptor 



20. The FRET standard of claim 15, where the FRET efficiency of the standard is determined 
by modulating the association and dissociation of the donor and the acceptor molecules. 

21. The FRET standard of claim 15, where binding of donor and acceptor molecules to the 
set of FRET calibration targets is reversible. 

22. The FRET standard of claim 15, where the donor and acceptor molecules are fluorescent 
proteins. 

23. The FRET standard of claim 15, where the FRET standard includes at least one 
fluorescent substance bound to a microscopic bead. 




molecules. 
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1 24. A method for transforming an initial FRET image to a processed FRET image, the initial 

2 image being represented by a set of pixels each having three color space coordinates, the 

3 ' method including the steps of: 

4 (a) generating a corrected FRET image from an initial image by correcting for spectral 

5 overlap by applying a transformation of the form to obtain a corrected FRET channel 

6 image F c : 

7 F c =F b - (F rf * /D b d )x D" - (F„» /A b B )xA". 

8 (b) selecting at least two image regions in the corrected FRET image, each image region 

9 including at least one pixel, wherein the image regions define at least two distin- 

10 guishable spectral categories; 

11 (c) performing a color space transformation on the corrected image, based on the color 

12 space coordinates of the pixels in each of the selected image regions, to generate a 

13 processed image; and 

14 (d) evaluating the processed image for a visible indication of an improved spatial 

15 distribution of color. 

1 25. The method of claim 24, including the step of further correcting the corrected FRET 

2 image for cross-talk resulting from detection of donor fluorescence through an acceptor 

3 emission channel and detection of acceptor fluorescence through a donor emission 

4 channel. 

1 26. The method of claim 24, including the step of further correcting the corrected FRET 

2 image for non-zero values of Ad, a signal from a donor-only specimen using an acceptor 

3 filter set, and Da, a signal from a acceptor-only specimen using a donor filter set. 



1 

2 



27. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F* by normalizing for the concentration of a donor. 
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28. The method of claim 24, including the step of further correcting the corrected FRET 
channel image P, so as to be approximately normalized for the concentration of a donor, 
by applying a correction of l/Df, where Df 'is a signal generated through a donor filter set 
when both donors and acceptors are present in the biological material. 

29. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of an acceptor. 

30. The method of claim 24, including the step of further correcting the corrected FRET 
channel image P, so as to be approximately normalized for the concentration of a 
acceptor, by applying a correction of XI Af, where Af'is a signal generated through an 
acceptor filter set when both donors and acceptors are present in the biological material. 

3 1 . The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c by normalizing for the concentration of both a donor and an acceptor. 

32. The method of claim 24, including the step of further correcting the corrected FRET 
channel image F c , so as to be approximately normalized for the concentration of both a 
donor and an acceptor, by applying a correction of \l(Df *Af), where Df is a signal 
generated through a donor filter set when both donors and acceptors are present, and Af is 
a signal generated through an acceptor filter set when both donors and acceptors are 
present. 

33. The method of claim 24, including the step of further correcting the corrected FRET 
image by correcting for cross-talk resulting from detection of donor fluorescence through 
an acceptor emission channel and detection of acceptor fluorescence through a donor 
emission channel, and by normalizing for the concentration of both a donor and an 
acceptor. 
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1 34. The method of claim 24, wherein the initial FRET image has less than about 5% 

2 photobleaching. 

1 35. An optical instrument for measuring FRET which is calibrated with a FRET standard 

2 having donor molecules and acceptor molecules and that relates a measured intensity of 

3 acceptor molecule fluorescence sensitization to a corresponding amount of donor 

4 molecule quenching. 

1 36. The optical instrument of claim 35, wherein a FRET standard, carrying both donor and 

2 acceptor molecules with known FRET properties, is used to a calibrate an optical 

3 instrument to enable FRET measurements. 

1 37. The optical instrument of claim 35, wherein the FRET measurements can be processed to 

2 yield a FRET efficiency E. 

1 38. The optical instrument of claim 35, wherein the FRET measurements can be further 

2 processed to yield a distance r separating the donor and acceptor molecules. 

1 39. The optical instrument of claim 35, wherein the filters within the epifluorescence cubes 

2 have been selected based on their optical surfaces having no more than 15 arc seconds of 

3 wedge parallelism and no more than 10 waves flatness. 
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1 40. A computer program, residing on a computer-readable medium, for transforming an 

2 initial image of biological material to a processed image, the initial image being repre- 

3 sented by a set of pixels each having three color space coordinates, the computer program 

4 comprising instructions for causing a computer to: 

5 (a) select at least two image regions in the initial image, each image region including at 

6 least one pixel, wherein the image regions define at least two distinguishable spectral 

7 categories; 

a (b) perform a color space transformation on the initial image, based on the color space 

9 coordinates of the pixels in each of the selected image regions, to generate a pro- 

10 cessed image; and 

1 1 (c) evaluate the processed image for a visible indication of an improved spatial distribu- 

12 tion of color. 

1 41. A computer program, residing on a computer-readable medium, for transforming an 

2 initial FRET image to a processed FRET image, the initial image being represented by a 

3 set of pixels each having three color space coordinates, the computer program comprising 

4 instructions for causing a computer to: 

5 (a) generate a corrected FRET image from an initial image by correcting for spectral 

6 overlap by applying a transformation of the form to obtain a corrected FRET channel 

7 image F 0 : 

8 f -f'-(f;/d;)x/)*-(f.V4;)k^ ; 

9 (b) select at least two image regions in the corrected FRET image, each image region 

10 including at least one pixel, wherein the image regions define at least two distin- 

11 guishable spectral categories; 

12 (c) perform a color space transformation on the corrected image, based on the color 

13 space coordinates of the pixels in each of the selected image regions, to generate a 

14 processed image; and 

15 (d) evaluate the processed image for a visible indication of an improved spatial distribu- 

16 tion of color. 
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Figure 4 
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Figure 5 
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